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ABSTEACT 

This report summarizes the f indlrigs of the 'EISO 
prqlectr which ,W4S fundea ii^ 1975 to develops e valuate^ and an alyza 
an information dis,seraination sy aten based upon computerised ^etrj^evai 
of biblioqraphiQs^ With mah of the resea icK co rtponen t porapleted^ the 
^ervica coiapoiien t is operational^ proyidi ng Ont arlb educators with 
cnline .,bibii6graphic references in education and the social sGiences 
and with access. :,to original docunents* , Findings of the report are 
reviewed in four" ar^aei (1) It identifies EISO users over the past 
three years^ presents their reasons for seelcing inf orma tion , proviiea 
analyses of/how information they recei-ved ifflpacted upon their local 
fiituations^ and identifies factors ^ that contributed to the usa ar >^ 
non-^use of information received, (2) It describes factors affecting 
interview effectiveiiess in online bibliographic retrieval^ , cuti-ines^a 
5*stage pattern or^structure in ne^gotiat ion, ai£Ciias,es the use .of 
opeii and ciosed questions aiid the part role and status play^in 
interview relation Shi pSp and develops a prellmiiiary aiodel of. tiia 
neqotiation process, (3) It diaciisses a systeme evaluation nDdel of 
user satisfactsion with EISO, (U) And^ it reviewa the , current' status of 
ElSO^-the result of research^ development^ dissemination, and 
evaluation • (J D) ^ , 
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/ ' * ' " ' SU^^mRi^C(F FINAL BEPORT ' 

Ihls paper suTmarlzes t|ia final report' of the. Eduoatlonal 
aifontatiOT ^stan for Oitarlo, resQa5di contract fun^d in Mardi 1975 ■ 
by the Ministry, of. Education of t^a Province of , Ontario, Ihou^ mudi of 
,tiie researdi oqnpanent of tiia project Is new oaTpletea tii6 servloe aspect 
OS EISO oontinTJes .to provide Ontario educators v^itii oilirva blls-liographic 
ratrieval of referenoes in educay.c^ arid the spcial scienras and witii 
fiidcess to original dociriients. 

EISO was fimdad to devalop, evaluate, " arid ^anaayae 'm. liiformation 
, c3isswdnatLco system hmmd \j^n catputerlTCd retrieval of blbUo^a^ifes. 
It differad f ran tiie usual researdi amtract In tiiat it ^as not only to 
pawide a rigorous . researdi study fimly grOTnded in theoretical concepts, 
■^ut it wm also to have a laj^ly developTientel cQi^CTient in' the iitpli- / ^ 
mentatd-on of a aeardi servioe avail^la to educatora on a" fee-paying ^ 
basis* IhuB^ not cnly were nramal aspects of contract researdi sudi as 
researdi desi^, data oollection and analysis r^gulrBd^ but also sdrfe 
TOre i^^usual activities/ Among these were the creatioi of a business 
^steti/ p^Uoi^ rnate^ials, prornptional worksh^k^ and. a prograti to 
train Eauca4io4al Infomation CcnSultants Who. were^ t^ act as infannation 
mterroediaries or lirfcage ag^ts in geogri^iicallj rerote areas* Pro- 
fessional develop^t acH^ties, seminars^ and derooristraUOTis added still 
other aspect^ to the study, The aspect of ttip ocntract tiiat was itost^ 
readily a^aten-t educators and tiie aie thafc still rontiriues was, hov^- 
ever, tiie actajal Creation of a^^ully opprational infoanation, sarviGe 
of iering an interactive mltoe bibaiographic s^ardi service to ttie e^ca- 
tors o£ Ont^io by providing thCT acoess to odstinq data bases sudi aa 
tJie Ontario Educational teseardi ^forTnay,on' System (COT^IS) ^ Opc, 
VMjdxologUal kb^tnRcM^ Emzpti^mi ChLld E^iacLtion AbstAaoAs, SooLal 
Science^ CMtaUon .Indm, VM^&AtaMon Ab^tA.aaZ6 lntmmtlma£ md ''o^&x- 
data bases . relevant to educators . r \ 

To use tiie EISO se^di service, tiie educator sttomite his mfqmsi-^ 
txm r^uest to the seardi analyst, a specially trained reference 
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libr^ian^ vAio ^velops a seardiyttategy that la madiine--readabl©p 
Bibliographies mm printed offllife^ by .a'major ociTiTBrcial surlier liKe 

* 7 

Loddieed or SystCTi DevTeLs^ient corporation and imiled to , the user who - 
niay then order original docunents'in eithefc Mcroficiia or papsr copy 
' foraat^, A fee based ori ttm m^jnt of professlbnal and ocirpjitar^CCTinect 
tme used Is diar^d for ihm tea^di md a flat rate for duplicates of 
original Items* / , , ' 

BmBme^cti ODnducted as part of tiie EISO contract f ocussed on the 
\jser^ and his' or her intaraction \gdth tiie serviaa* Ansv^rs were sought 
to the follOTing qufisU.onsr ^o uses EISO^ aid why? Hot satisfied are 
tiiey wltti tile servioe? Wiat is tiie nafeire of tiie interactlQn bet&^TOn 
^e client and the seardi analyst during question negotiation? Md, ^ 
Vffiat are the inter-rela^OTshlpg between tiies^ ^/arious assets of tiie 
seardi service? Qor ansTOrs to these qmsticns and tiie inf luanoe of 
tiiese answers ' on the current organlzaticn and opera^^ons of EISO are 

topics of this paper* . ' ■ ; 

"Bib User andytfe Uses ^of EISO Inforamtion . ^ ' 
■rile growing ,ijTp6rtanoe .of the prfavision" of InfornmtiQn by auto=- 
mated toots has been reflected in the= Increasing nunr^r of articles smd 
studies de%^ted td'oilirhe refermoe serviaes, Hie^foci^ of rmidi of tills 
vhrk aentre§ ^ound developing accurate liostijig te^dmiguies and describing' 
and evaluatirlg" specif ic services* Hie users of tiie$e..4ewioes have ^ 
received little attention, Goierall.y^ hwever^ ooncetai for ttie user and 
the way/in whldi he uses the infOCTaticn he receives Kas.^been of greater 
oonoem to educatlQn5.1 researdiers iid socibUbgiste thiui Ijif DiTiaU.Qn 
specialists* ^lis Gonoentratlto is understand^ le, InforrtTatlon mmagers^ 
librarians^ and seardi analysts can rarely/ Influence the use of the 
ihforTtiation they provlde^ to tiie userV^ lo^l <^d.gencles, adnlnistrator 
aoiTinitriEnt, fln^cial oonstrainfs^^ thS^poli^cal climtB may all inpinge 
oi the ultimate use . of retrieval ijnfoCTfatid&i* rronicaliy^ ^hOTever^. it 
is the effective use and iirpact of tJi^^seardi result f^at may detemlne 
Wietiier or not a ijser perMives tiie. servioe ±0" be useful , and bewrnes a 
satisfied client yA\o retums to tiie seardi stn^oe-bo.plac^ fTortiier 
requests, tod it is i^n the building \^ of a rep^at-use^ clientele 

tiiat tiia aur^-dval of a seardi servioe de^m* 



purposas of tills secti^on^ tiherefore^ mm to iden'^^ EISO 
m&m prmr the past thr^ years, p^*es^t their reasons for seeing 
infowmticai^ prof^de atialysis of hov^ tiie infohmtionrWpy mmis^d im= 
pactfid i^n thfeir local; situations ^ ai^d identify factors tiiat Qortt^ribubed 
to usa of'non-TJse of infomiation raoeivedt 



User QiaracteristLcs 

Location p About half of EISO's most.r^oent users oonie tram tiie 



because sone professiaial 
purdiased ttieij: OTn * 



^fetropo^ital Toronto aineai pro^fidijig the mainstay of tha servioe, ThLm 
•high figure has rermined fairly stable tiirou^put tiie project's three 
yaars, a fact tiiat is all the mret interesting 
libraries in local sdiooL boards have ! reoantlyj 
tfirmlnals and ar:e offering tiieir am seard% sermcss*' Ihis leads 
cmm to su^ect that tiid actual niBtber of users from greater TDronto 
arm may going up but that tiiis ijiCTease is beirig partially obscured 
and abloitoed by other avail^Le servioes* < , 

Die nuntoer of users frcrn tiie Ottafli^a area has inQceaaed froi3^1*9% 
tn 7 , 8% ^ ^^rhaps refracting the fact that several workshops and sonlnars » 
were ^given^ to govermnental ^f flcials and at supfjer oourses held there 
thus raising avareness of the s^rvioe and acting as a stimulant for usage, 

A rise of the ntjtber of users from provirioes other liian Oritario 
(.8% to 3*9%) may refleot ElSO's new; poli^ of prdoessing all requests 
rieoeived regardless of tii^ir geogra^ical origin. 

Persmal Characteristics. Hie age> sex^ education^ md pro-- 
'fessional activfcLes of EISO users have remained sttble over tfie-tiiree 
years ttie service has been in cperation, ^o="ttiirdB of tiie users con- 
tlnue to be male^ and over ttiree-^arters pf all^^SSs^^are betomen 26 
and 45 years of age. Most ifeefs tia^^ TCcypied tiieir present position 
for le^s than tu?o years. Over one-half are offioers of a professional 
organization, have participated in an educational researdi propact in the 
past five years ^ and haw presented a professimal paper during tiiat tiine, 
Six^-nine per^nt have'eaxTied graduate 'degrees^ vrtiile 57% are OTcrently 
enrolled' iLn, or areplamiing to apply for^ acadsnic prograns l^^ding to 

a iilgh^r degree^ y * ' 

Clearly ^ EISO users are a highly professioi^al, ^^^niic^ ^ell-- 

. : ' ' ' ' '1 

educatad^ md E^rfcatious g^oup. 



\ . Organiga^Qn. Wfiilli OISE is still tiie insUtution witti ^idi 
most usars affiliatad^ it provide of^y a little over orterthird of 
tiie tdtal nmber of user^ (36.6%)^ a decline frcm 39,^5^ the previous 
y6ar/ . Fdpultl^ of edui^tion^ MiniBtiY of Educati.on, and otiier goverji-^; , 
ittint agencies crotiriue to provi^ inmeasingly more users idiiie the 
nittrbar of sdiool b<ferd-cli^tele ramain steady. 

Role, The roles performed by EISO users remained for tiien^t 
^ p^t oiAan^d^ Administeation and teadiing are still the meet 
ijtportmt roles occupied EISO users* Wifis© ar^ follc^d by graduate 
work and ^researdi.} These profiles df user roles have ^oti litUa 
variation oi^r a yiree^year period and will probably pontinue bo remajji 
stable, • ' ^ 

The distribu'ti.on of i^re by their rolas^ in various orgmis^atiDns 
is as follovs- In pifclic b^rds^ users were mMt lik^Xy to be a&dn- 
iatrators or si^rviBprs (S7^) though other sbaff^^also.us^ EISO servioes 
' to a sii^ificant ^gree with teadiers^ reaear^er9^' and librarians Mrrb 
prising another 3S% Qf boajrf users. All users frcin tiHfe ;separate boards 



fell within the =a4tdriisteatlve, ranks vAile users in post'-sfeaOTdary 
Institut^ohs were di^telbuted arong adhunistrators (33%)^ taadiers (531)^ 
and students (7%)/ Most OISE users TOre^tu^^te (43%) tiiou^ otiier 
* staff categories were also represented* BegionaL Offi^ personnel wera * 
tile largest (60%) user groqp ^t Minis tey of, Educatiorfcf" 

It^^uld appear that tiia patterns th^t w&re established' in the ^ 

' first t^ years bf Tttie^ servide c»nti4ue, to hold, .E^SO is used as a' 
resouroe prinia^cily by a^nartts^a^w ^t^rmel in sdiool boards , I^* 
faculb/ in postrse^^dary^ instigations sfcufents at OISE, 

. and by a(aTanistoativ^e-acld Begional Of f i^^.staf tte J^iistry of 
Education. ■ ' /. ■ ; ^.^ . ^ - 

i , ■ » ... - ■ - . ^ . ' ' ' 

* Purpose of Seardies A ^ ■ ' ^ ' A : ^ f 

Airang all lisers , \tiie mMt 'frequently cited purpose for^ doing a" ^ 
sewdi was for terra papers ^ /Rsseardi ^and devel^tient^ apeeches or 

- articles, ^rsonhel or 'recruitirent and progr^ deveLopnent were ^Iso 
li$^d as the pin:poses for playing EISO searches,; t^ers tended to 
a]^roacfi EISO €s a resoproe to si^ort thelr^priJnary pro role. 



Fot exanrple^ v^fitiiin s^ool boards acininistritiari was the'|n^t fs^uantly; - 
mentiOTed role for doing a search,' ahese adndjiistrative | I^r-' 
foimed seardies to aid tiion w£jK^ tiieir rBspbrislbilities lor program * 
iitprcnnenient (23%)/ personnel recruitment (m poliq^ deWl^itent (13%) 
and currifMlun develcpnGnt (13%^. ' ttiOTgh it wbuld A^ar^that p fsw ; . \ 
adnv^istaratOTfe" did glace seardifes.to help.iri^ ^tinjgxr gradua^^tudias/ * 
iTOSt sou^t iriforfnatiOT. for pit^oses oons|stent with their ^rofesgional . 

^is quantit^ti^ data gi\^s a general ^verviaw the uaer^ ' ' 
population and their raasons for r^juesting seardies, ToproWae a. ^ 
TTom feounded picture of tiie hiaran .motivatiori /that pronpts s^cif ic . 
seafcdies and the faotors that con tribute toward^ ttie sucoessful i:^e of 
tiia infoCTnatiQn we mast t^rito deSCTipti^ or qpalative data* Sudi data 
is of Qoturse* dlfif ioalt ^ doCTOTarit^^J assess , Often infliionoefe beyarad 
the pDntrol of the -iiidiVidual, are overriding factors in vdiather or, not , 
^ inf Donation is used for tiie purposes for whidi it was originally sougfit. 
Another lindting factor ie/ that e^^denc^ oJE usage has teen OTToplled 
through interviews tiiat rdlied on self-reporting* .Thoi^h onsite observa-^ 
tion may have provided more / reliable evidence i seven case studies were 

carried out for the i^isi^t tfiey rrdght provide into sarie of the eLemanta 

' ^ I / ' ' ^ ' " y 

that detemine use or nm-use of search results. In each oaSe, lii-deptdi 

interviews were used to collect information. 

■ '■ ■ ■ ■ . . •■ ■ ^ ■. ■ I 

Factors Contr^uting to Usq o£ Non-Use of .Searrfi Results 

Ih.e seven ndniWeases are described in Idie fiill report, and tiiouc^ 
they represant an admittedly ^ini ted SOTple.of i^ers^ :j^?ertiie_less point 
to soTie factors tiiat eilpher encourage ot pose barriets to tiie use of 
Infonnation raoaiyefl^ as a result of placing anf^EISO seardi. These factors 
may be evident during botii tiie pre-'Seardi and .^st-seardi and are described 
in ^ Table 1, ' ; " ' ^ ' ' 

^ ■ " It is interestijig to note that whereas in tiie cases of ffiucoessful 
information use eadi user spurred on* by the need to rej^rt to or Work 
with staff or oaTmittees ^ tiie n^-^users were All Imers* It might ]x 
e^^cted/ tii^eforl^ tiiat #iey would have to ^splay greater independ^ra, 
self-reliant/ and ^rso^^m^yi%y=on th^ the successful users snd 
would not have the rewar^ of In^diate positive fee<S5iBk* Ip -die cases 
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dealt with here, this ijicrQased bijrden ofi.rGSponS3iJbillty wiUiout positive 
eKtemal si^port created ii barrier to usG/iiiat was not overocms.* 

User Satisfactidn wiUi EISO > , " ' 

■ of tile nioBt inportont and, most diffioalt aspecta' of an mline- 
seardi . servioe to evaluate is the satisfaction of ttie user. User 
satiefaation is si^iificmt bemuse it will affect the ulUjnabe success 
of the servloei ' a satisfied user is niore likely bp berara a re^at user 
and an advocate o£ the ^stem ttiat has tmt his na^ds- i^d it is tiie 
build-i^ of a steady cliGntele and tiie spread of Its sucoess by /wortJ 
of mouth that will help to. ensure its, long-- term operation, Measuririg 
user satisfaotiQn/ hOTemr^ is fraugfit witii diffiwlties for we are 
trying to Msess what iB, after all ^ a state of rrtod. Not only is it 
hi<^ly si±>jective, but it is in all likelihpod sii^ject to frequent shifts 
and dianges* ' ^ / 

Reoognizing tiiis OOTplexi^ the Educational Infomation ^'stOT 
for Qnt^io developed on evaluation sdime based m a systeire model. Wing 
^ psycJiological, sociological, and eOTianlc vari^Jj^a wittiin an adoptioii 
of innQvations fr^ine^ork. ^ 

Yearly Satis faqtion Averages 

h CdTparisoji of tiie average satisfaction 0£ EISO users over ttie 
thr^ years, of the servi^'s operation shOTs a 3OTWrksble oonaisten<^* 
Changes in average lavel of satisfacti.on ran^d ftatn an increase of .20 
for %*irreliness of Service to a decrease of .04 fo^ . dually of TedinDlogy. 
Ihere w^ virtually no significant variation in perceived saHsf action 
amcrig EISO users over the three-year period with ttx^ average user being 
i^ly satisfied with the service he recei%^. VhiB high average satis-- 
faction was e^ressed by means of 2*61 and 2,78 for Overall Satisfaction 
. and Quali^ of SmrviOBp res^ctively, on a three-point scale, Fmmr 
than 5% of usars were not satisfied witii tiie outputs of Uie serviM^ tiie 
Value of tlie Bibliography and Materials^ during to rrost reoent year of 
aeration. TOiis repres&ts a significant inpravMent frori tiie more than ^ 
12% who ej^ressed reservations the previdus year or tlie aliTost 10% iJ\ 
' the first year. Clearly, EISO contljiues to inprov©^ witfi over 951 of , 
/ users being satisfied with the servi^ provided^ 




Mmittily Satd&f action Averages ' ; ^ 

Ptiile it is trUG tliat, on tiie vsAiqle, tHe ICISO service is, main- 



.. tatnlng hic^ s tandards^ ^ f Liictuatlons do occur f ran monyi to nonth ^pend- 
Ing oh tiie time of year, major char^gea in systCTi' operations, and t^ia size 
of tiie sanpl© for v^otn resiDOnses were reoei\^d» It iM as well to/ repog- 
niM tfiat Idiias^e variations do occur and in fact a^pecir to be a npmal- 
part^f the smrvioB envlromBnt so that im3ue ^Kiel^ or uncalled for 
^ifts in poii^ are avoitod, - , ^ / 

^Mong the nvOTt iTrportant neasuras assessing the satisfa^^tion of 
ysers with BISO are tjiose' avaluating. jtiieir peroeption ^out the Quality 
of Servioe smd the Value of Bibliography and Materials/ B^caiis© of ttie 
iitportanpo of these aspects ^ tmsin satis factim levels of users regarding 
thCTi were plotted on a noithly basip frOT July 1975 througli C^tcbet 1977. 
An ^ a^rage C^/erall Satisfaction level waa also i^talmd. 

It waa found tiiat Ov^erall Satisfaction was rCTimrkably steady^ 
ran^ng betifeen 2.4 and 2,7 on tlie three-point bc^IM- mplaykd, 
.The monthly average remained witii.in +0.1 units of 2,6, h motioeabl© 
drop did occur ^ h<^^%^r, during tiie Spring of 1976 but thj/s was ■ / 

attributed to ttie hiring and -'brsaJcing in" pariod ;of a new search analyst, 

fe'- _ . _ ' ' . _ _ / 

It was also noted tiiat overall satisfaction tended to decline during 

th^e periods vAien demands for searches reaped peak levels of "55 or jmxml 

per nratith, * ^ 

analysis of toends sinoe the OTplcr^nment* qf '/tiio seoond sear^ , 

analyst reveals two interesting features. First; th© prwiously cpser^ 

feline in satisfaction lewis with tiie Value 6fi Bibiiography and idat^ials 

during hectlQ periods sscts to be cbntinuinf/ thou^ witli le^s firpqujfrt^, 

this "decline*' W satisf actidn /is a 



)r Wis iteni rmwr fell 



It ^^ould be noted/ ht^mvm^ that 
relative thing* That is ^ me satisfaction leTCl 
below 2,0 t^to?een Oct^er 0576 and OctdDer 3377. /This means tiiat evnen at 
its worsts tihe service waa never seen to be belo^ a mediun-high level of 
perfonrwioev ^ ^ ik* 

Second^ tiie Quality; of Servioe has on f6ur separate occasions 
(Septenber 1976^ Nowjrber 1976, l^ril 1977, Atigust 3377) been assessed at 
3,0, tiie hi^iest level atteinable on a scal^ of three pointsX During 
that sane Oct^r 1976 to Oct^r 1977-perio^ Qualifef of. Servioe never 
fell below 2.7 and hovered at tine 2,8 le\^l% 

. ■ ^ ■ ' . . V ^ / 



EKLC 



.11 



/ ■ • = 

satisfaction of EIC Versua Nqn-EIC Users ^ , ' . . 

Because tJie hiBnan eleinant of relaying and using, inforniatibn was, 
. Emm the vmry beginning^/^of Unis , raseardi project^ regarded as ^itical, 
it was felt tiiat sane Special pro^sion had #to be rmdm for users ' 
were Ijocatod at a di^tonpe" from Met^^litan Toroftto and thus did not have 
ijTinedi^te acdesa tO/ the sarvlaa,^ TtiB basic assimption was that the pro- 
visicDn of an interinedi^y , called an Educational Infortnatiori Gonsultanti 
or EICi ^familiar with l^al ODnditiops and r^ds^ ^would lead to a more , , 
satisfied .user and more' effec^ve ' dissemination and utilisation of knot/- 
ledge. ^In tun6, a satisfied mex, adoording to adoption of innQvation 
mbdela, roul^/be e^qDected to beoanfte a repeat ^user who ^^ould have tiie' 
obvious effect of ensuring the maintenaftoe and growtii of tiie informattGri 
service. ■ ^ : - , ^ , - ■ , 

' ' to/ test v^Q tiler or not such assUnptions could be pro\^d eitpirically, 
special treatment was giveh to ttie. Nortfiwestem Region of totario* . There^ 
four EICs^Hn different -^^s of institutions v^re t^ained^ ^irpristeaticns 
of^tiie s^rvioe were heldi and r^uoed rates were instituted for tiie first 
year of /the service's operation, / . 

/ Ihe first goal the EICs wero asked to/adiieve in their, initial 
training was to make users aware of their availability and liie services 
they oould provide, Thmrmiore, one would eiqpeet tiie EIC users to be 
sarev^at more satisfied witti their infprmatipn ^out tiie sermoe than. 
non=Efe users who wei^^not ei^sed to sudi ^rsOTal efforts. Iherfe, i 
evidi^^ to support that ti\is was in fact ^mJqaBmu ^ In particul^>"' 
iM;W slight teridency for EIC tisets to^^^p^^satisfied witti specifi^ 
aspects of : the autcnated bibliographic retrieval servioe tiiari nm^EIC 
users,' , These areas of greater itean ^atisfactiOT focus on the piiDlicl"^ 



cbdut and directions ^qr using tiie servi« and the quali^ of the /tedh- 
noiogy/ EIC users are 1^1 satisfied than tdieir non-EIC oomter^rts 
with those aspteots of tiie se^^ce that add anotiier, step to Uie Ardaring 
prooess^d tiierefore slo/a down tiheir re^ipt of tlie in'fornmtioi. This 
miggeste that the EICs r&Le tnlght be imst useful in the prelii^a^ . 
stages of raising at^areness and providiiig' directions for using %ie servioe. 
fit would appease that tiie intenmdiate stage of seardi negotiation nd^t • 
be left to tifie seardi analyst and the ordering of iriaterials to the;i^er. 
In that way, nrnxiiiMTi use might be made of tiie Iteal availabili^'of tiie 



EIC, tile teduiical ex^rtise of _th0 ajialyst,^ and tlna entiiusisstic need 
of, the use^ for a mort speedy/ delivery tiite. 

^ '. ' Sibliogra^ic tetrlaval ' ' . ■ ' 

One of itiDSt iiTpor"tari t 'aspects of online s-ear'ch serid^oes is. 
tile negotiation prooass thst takm place tetoeei^ t^.. libr^iaji or seaJcf^ 
analyst and ttie :^er seeing dnf amnatioii . Fo^: it is dur^ing tfiat enooMnter 
= tiiat tte^user must maKe Ms needs Jcn^wn, tfee seard^ arialyst must carp re— 
hend the request, m\d translate it into tiie t^nmnology and Mnf iguimtion 
that will result iri tine suc^ssful mtri^vsl "bf apprDpriats citations . 
Yet little has b^an writter^ t^iat atterrpts tJO analyse \what happenJ during^ 
tlie negotiation process. A. rmvL&j of tha Litjeratu^^ c^ried out to 
identify the major QlmmTitB of t?iat p^ooess outlined in the Litoratur^. 
"rtiese theoraticai^ catpot^ants were ajpHed to actual negotiation ijiter-- 
Viev/s to ascartaJji their applicability tiier€to, and to develop a node.l 
_.:iat descrites tine oorfp^ent elements Qf the negotiation pr^o^ss ^ The 
.d£vel^iti^t of sudi a inodel is seen as h^i^ig i-rroli catioris for tine 
trainirig and f^rfornian^^ of setiroh^ an^ly^ta and thierGfiorie e_^intrLfc)utincg t^ 
tJie improvOTent of autmated sGajrch services. 

Factors A^ffecting Ijiterview Ef feuti'vemjss 

Qipathy^ It is rooagrLiz^cl t[iat tlie absornoe of: v jde^Jt-^ai^eS iriposes 
some limitatioTis on the ealoility txj fully capturo tli-o nuarnces of facial 
e^Kpression* tha position of th€ t-tonds anc3 boS^'^of tine ^ Bk^cua^i ^laiyst, 
and to idanti:fy all e>diibitjed £iB£_peati3 of rionverbe^l Jjel-aviouJr u/tiioh fh^^ 
soa^ch analys t rrakas iise of w prOTiot^* e^i|->«^ithy vwitli tiie risai . 'Itu- u^t^ 
of tape-^raoorcilngs do, hCTo^/er ? n^'dce it £_xjs^ib le tij icSjntit^ ont^ catagui^' 
o £ ^ipa tha ti 0 beK a vdoLix f tlie u^e of v^e Jt ^ 1 c-inci i^mv^ tt> ^^£7"^ b 1. oria ^i c1 
In -a warm^ acoapting oJid mcterstajicLx^ng nmruier. 

E^cani^les are ijiteiiri^^r sti^h^rnQntB siidi m^' "[ir~i^inm^ " ifcpe^^ 
tition of tho usor's l^^st stateiTie-rit^ teol U^at (last s'^atjertKJnt sa^id) 

and oop^fiming st^t^JaBJits sudi as "Vos , tJiat seenns to mijco senfio, " OtHor 
fonnfl of airpathic beha^ioiLr incUido hirniotu:/ and stater^nt-a Bual) mB *'0}cay," 
"Dli-tiuh," "Really/; and "Qw I se^D, One inplicatiori is timt tjiis fomi of 
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behav^iour ejioourages ,thQ user to relax and talk freely, rather tfip 
v/ithdraw'^ into uncamfort^lo rronotmid responses. EnGquraging the 
user to talk solicits informtion ^out his topic C3f interest whi* 
is crucial to^ the unr^r s tancllng o.f' his pr^leni. Only if tills- first 
• st^p is OOTpleted success fnal ly ^\ ^an the sear^i analyst ^move ori to tints 
next stage of att-ejrp)ting to int^ipret the proble-m in tern^ of des- 
scriptors on the system. ' J 

In practice, wq foundj/ti-cst of thm search analyst 's ^etpathJc 
comTtente relative to the totil of, such carmiBnts uttered during the e^iti.re 
in texvieiv occurred during 05^-ning minutes of tfie interview it 
is vital that tine user be ../at ease and talk abaut his t-Opic of int-erast 
as fully as possible. 'Dlfis undoubtedly ^ill also influenoe aser satis- 
faction with the servi^ generally, and his decision as to vs^ie tlie^ hes 
^\^ill uBev.tiie serviM acjairi and/or favourably recctTTnend it to his col^ 
^leagues and friends. 

Ttie StruQtur© of NBgotJiation. Hie i^derlying five-stage vpatterxi 

_ - — - " - — — — " " ^ 

or strTJcb^ire tiiat la suggested by the literature for int^rviev^s oon^ 
f i nned . 

Sfii.lL' One 

The first stage revulves around the analyst *s atterrpt t-O cle&rl^ 
understand the user's x^equost. This, seems to be a nost critical staCT, 
for only after its suaotBSsful corpleUion can tlie search analyst rrove to 
the serond stage . Hlife lengtli of ^tlae -first stage depends on hc:^ cLeaxr ly 

' the use^r has i den t^i fled tind defined his topic in liis own nujid,- the (Xj-^^h 
plexity or uniquaieiss of tlie topic it-self and how artiaulutifca tlie Liser-s 
are Lii e_^xj.jlaining tlieiL need tu tliu tinaLyBt. '11 le deqrtft^ of usou cxitr^Ju - 
lotd-On in this study tends tote cjiute high, sinc^^ users art? geBnereilly 
c i tt le r rnas te r * a o r doc to 1^ a 1 s tuden t3 , i sru f esbo i s govt" vi nmnt cuMwi r 1 i b ta a t^^4. -a , 
or nniii^ors of sc£ido1 bocrrds. In tlii^ stacp also,- usery ituy Ijo qixnm x\ 
fjeneral out liner: or description (or rrtriy even ask for sucli) c^t fiw tiie syfeptojii 

morkB. "ihis tends to pro\ride son^ preliJiiinfiry ewn if linii tol o"u:li.^rB tandi nq 
of t}\a relationship bo&veGtn tJie toriTB (descriptoi^s) and hOT aac^ess to 
the system is abta.inod, and seerms a valaablc preludo in latx^r lielpiiig to 
identify c^scrLptorEi and key phrasaSp 
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The seoond stage involves an effort to:identif^^ the major areas 
of tlie user's topic of interest and to matdn these with mjor ^scriptcirs 
or phrases v*uch will provide acoess ,the data base(s) , Witii ttie first 
' stage over, the seMnd prooeeds fairly r^idly. Sinoe all the users are 
educators of one sort or another, tlie terminology used tends to be lirnited, 
allying the search analyst t^ build up fOTiillarity with the language 
of tiie discipline. In rtttt instanoes^ relevant tools sudi as the ThuciLiAiU 
0^ ERIC ducA.Lpton.b located on tine analyst's desk is ooasulted by the 
user and analyst during their interview. 

Next <OTies the identification of terins related tg thes riiajor 
descripbors. In tliis stage an attanpt is usually rnade to broaden and ex-- 
tend as much as pc^ssi^le tjie topic first presan tad by the user. In this 
stage a list of very specific words (descriptors) is identified. Ihis 
process' may be a fairly lengthy one and with the possible exct3ption of 
the first stage, nmy t^e tlie rrost tLriE during the intarvisw^ 

stage Foal ^ 

During stage four, the seardi analyst outlines tlie mix\ and 
alternate stratagies she will use in ttie seardi^ and ranKs ancVor ccnfeihas 
the related te-rro witli tl^ie mjor descriptors/headings. This stage usually 
acts as a frurther clarification of tlie topic and the ciajjectB of it ttiat 
are rrost iirportant, and tlie user is asked to further extend, change, or 
mDdify ti'ie terms as neoossar^. ' ^ 

Stai]c five 

The closing st^^je rs usually ciavtjtjod tu ''houstiKutpijig iiiruiination" 
when thu user's addresa and billing instructions cu'ti ubuunt^d eirid he is 
told how imch material to expect, wtien., and hov rnULdi it is llkeiy to 

□□St. 

It should be noted that while Stage One usually cdcxtuts at tlie 
beginning of the inteiviow situatLon, tlio rainaining stages do not 
ne^ssarily follow stxTuentialiy in tlie order presGnt:ed above. For eKanple, 
an indication of what tixo user c^n eKpect in terms of tiic volurre of mataria. 
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rmy occur imnediately after thd^ first stage or the seardi analyst may 
preyed to identic related terTTs during the first stage m an attarpt . 
to un^stand tihe topic mDre clearly (especially if it is^a cOTpiex or 
jjnigue cne) he£om m^ing an attCTpt to specify and list mjor headings 
In spite of variations, ha^rnvmr , tiie basic underlying pattern dDOve 
tends bo persist. 

Open and Closed Questions . Ihe dastrijDution of "open" and 
*'closed" queBtions asked by the search analyst in the four intarviews^ 
appears belw: 



TABLE 2 

OPEN AND OLOSm OJESTIONS J\SKm IN OTTEIVIEWS wmi 
USERS A, C, PND D ' 



Open Closed length of 

User Questions guesticris Intermev/ 



4 3 40 minutes 

3 7 9 9 rg^utes 



Q q 27 33 rninutes 

p 4 Lb 21 minutes 



TTie frequent use of 0\^: ay^-n Liu^.-ptiuii tii-iuuuiLagtj^ the liser to t^lk arid 
tiierefore allows hini to shapu his roc^&t. It would Im ^t^cuad, thei^ 
fore, that itam "open" cjuestions touM occLir u\ tliypeniriy minutas of 
eadi intei^iew whan the user miLst eTOldin his reic^iest. Tliere semm Uj 
be good support for this oontantion in tlie foui^ IriterviaAfs t^ing cxxi- 
sidered here, lit the inteivi^ witii User C more ttian OTe-half of the 
open questions (five out of nine) wem asKed in the first four minutes 
of the interview; in User D's intarvdOT/ me-half of tlie total of sudi 
questions (two out of fOLir) occurred rn the first seven minutes; and 
alTOst onQ-half of tJic^o found in tlie interview with User B (thrt^o out 
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of seven) occurred within tiie first ti^ n^iutes, Thm ejc^ption was 
iJae ?jiteCTlew with User A, \*are, m tiie first fi^ mimtes, only one 
out of a, total of tiiirteen questions appeared, 

Vhm reason for ttie laclc of sucli questions at ttie. beginning of 
m ^.tarvlew wiUi User a" B&mm to lie in ttie seardi analyst's atterpt 
to pin tiiG user down to^ipecific berim very early in the ihtcrview, m, 
having begun the interview with an open question, ±\m re<Ktved the - 
indication that the user's'tiopic was an unusual one for vhidn there were 
, few applic^le desCTiptors on tiie syst^. Ccaitijiuing to describe his 
topic in general tenm, therefore, would be of little use. In omtrast^ 
tiie laci^ of open questions on the whole in the tnterview with User D 
(there were cnly fotirl" seems- to oCCTir because, fron the user's first 
explanatori/ sta/^feit, the ^ar^ analyst was able to say "I think that 
kind of thing wouldn't be too hard to f ind actual ly , because therR are 
sonie very specific words" and began' to ask closed quaations in order to 
cbtaijn a specific Listof descriptors. 

It may be cbserved that the EI^ searcii analyst spends the 
gre£it©r part of an interview ad<ing about spe^^fic terms, suggesting 
particular descriptors fron the Tha^aiLALU ERIC V^^ tn^tp to u, explaining 
to tlie usar \^^lat they nean, and indicating h6w she will ocirtDine thsm in 
tine seardi strategy. Because of tiiis need, th^, for a listing of specific 
headliigs bid specific canbinati^s of major and related descriptors^ the 
search ^ analyst -s use of ttie closed questions doriinates the interview 
after ttie opening few minutes. 

^le an d Status RelatiCTiships . WiUi xegaxd Uj tlie qi^stion uf 
role relationships, the situation in whidi the EISO searc^i analyst find^ 
herself is in many ways different frcrn that of a ix^ferenoe librarian. 
Win lie the lattiar may find the interviews unscheduled and opmenaed, tlm 
seardi analyst often makes an appointa^it with the user befor^and, and 
iMny tinies has at least scm; prior Imow ledge of the user's topic, Purthtir, 
while lad< of tliTie and the conrpetlng attention of otlier iisers may be 
variables in the library situation, prior ap^intment and tlie fact that 
tine EISO offi^ is located in a separate roan in the Library of The 
Ontario Institute for Studies in Education, effectively olliTdnate these 
difficultLes, 
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Initially, the sex of the user was presmned to be a vari^le 
in both stataas and d&ference pattems Lji the interaction. However, 
bearing in rnind^me IJjmtations of a E^-reoording , this factor waj not 
fomd to affect these patt^s. 

While tiiere ^as no role differenoe in cliente of different 
there was a difference that appeared het^mmi acateriic and ncn-academLc 
clients. The two acsadCTUC clients, both of whan were by.dianoe inaster's 
st^itoits in psydiology, stated their questions in tanm of formal rasearc^ 
designs. 

In cOTt-raat^ the gitestions of the t^o non--acadCTdcs ware rrore 
open-ended* Oie wished to Knw about the role sdiool librarians and 
children' s readirtg habits; the other about OTt^uter^assisted instruction 
for teaching brain-dajnaged diildrm a mode of syntoolic carniTunication. 

Developing a Preliminary Model of the Negotiation ProTOss 

V^ile'^^ecognizing ttie danger of trying to generalize outavard 
froTi a arall saiple of intarviafs, a nimter of points nevertheless are 
suggestive. First, tiiat same of the issuesf^ raised in the litarabjre on 
tile ^traditional referent interview are also helpful in studying mline 
negotiatiOT prOOTSses. The aspects ttiat h^ld most relevance seejri t^ be 
those associated with enpathy and non-verbal b^aviour, the staaicture 
of the negotiation, and tlie^ use of open and clos^ questiOTS, Hie me 
aspect that does not seCTi to bear mutfi re-levm«^ is that related to role 
and status relationships. Seoond, these elerrents seCTi to he oonstajit at 
least in sore degree regardless of the natLire of the topic, the user, 
or the syst^ used. Such an dDservation leada me to the notim that it 
rmy ba possible to represent these atabia mlmmits by aonstructing a 
nodel. Such a preUininaiy attenpt to visualize thu negoUation prMess . 
is presented in Figure l 

Fran the onalysib ut tTie inturvi^s, it became clear that the 
negoUation process is not a rigid progressioi Kith a clearly def ined= 
beginning, middle, and end tliat inexorably follOT upoi eadi othk but 
ratlier^it has a n^re' iterative, reifctitive nature ^as the determi^tion of 
the G^dific requirermnt of ti^e user erorges. ^ It Uiereforo oould^not be 
iBprescnted by a siiiple linear design but called for a more dynanuc mode 
of representation. Tlie notions of rQiteration and dynamisrt\ brought to 
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mind the nodel of tJie spiral currioaum in education and the doi^le 
helix in noleoilar-biolcsgy. Ihe rontier incx)rporates tiie idea o£ 
returning to concepts alrea^^ introduoed to ^fine and le^ ^ut than _ 
in grsater ^tail — a prooesa the analyst uses as she fioves frCTi a 
'general' mferstaiiding. of. the user's 'topic to the more sisecif ic ■dwioe , 
of descriptqrs and seardi strategies vAiile -the Latter draws aft^tion. 
to ttie multipiiciti' of inteiwD%«n Unks that are both mnstant and 
different in all of nature. Obviously, close parallels cannot ba dram, 
b=jt the notion of using spiralling strands seemed to aarbirffi OTntinuoualy 
e^,folving specificity with dynanic interacticn. UnliKs th^ elegant aim- 
plicibi' of the double helix, however, the model of the ne^tiatiai prooess 
was pictured as having at least four oat^rant elements. 'Hiese are 
associated with the user,, the search analyst, the topic to be seardied, 
and the systsn to be used for searciiing. It is not the representation 
of these holistic eleiT«nts that is the aancern here but the depiction 
of the eleitents that surfaoe as teing ijiportant diiring the negotiatian 
process. At a micro level these have been identified as errpatHy and 
non-VBibal behaviour, structiore, and open and closed questions. At a 
trore macro level, the iitportance of a specific diaracteristic sudi as 
enpathy can be broadened to stand for beliavioural charactarisUcs ^in 
general and the specific nethc^ of using open and closed questians for 
a broader range of tschniqufis used by the sear^ analyst. Ihe notion .of 
structure is incdiporated by the sequential progression of the interview 
Ln stages thr-ough tine. In addiaon, there are at least tojo other strands 
that weave through the typical negotiation proress, the substantive oon- 
tfint of the request and the tadinicali|ies pertaining to thf choioe of 
.dfiscriptors, the' fomulation of seardi strategies, and the operation of 
tiie system artd data base chosen, the first of these is represented by 
tfie tBrm "topic", tlie second by "system." 

Wliile the nodel is neorit to be suggestive of general pfienorrena, 
it could be adapbed to rrore closely represeJit specific negotLatiDn inter- 
views. For exanpla, strands may be broadened or nariwed, lengthened or 
shortened to sha^ when and the exteJit to whidi individual elements occur. 
«iey may be divided and oolor^cockid to enphasize the prijiie participant in 
the pro«3SS at any given tine, whether it is the search analyst or the 
user. Specific environmant^l influenoea tw be shpn trD effect tlie tums 
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the interview'^es . Such detailed mapping, however, must awkit i^' , ' 
depth analysis Wived frcm a larger sart^le of negotiation interviews. - 

Systems Evaluation of Oser Satis faction -with EISO' 

A sys tens' approadi used in developing tfie franfiwork, incor- • 
porating the traditional categories of input, procsss, output, and f«2d- 
back, in its application, particular enphasis is plac3ed upon assessing 
tiie relationships between variables of interest at different stages, 
such as input and output, while con trolling for the effects of inter= 
vening variables. It is hoped tJiat in achieving a better imderstanding 
of such relationships, tiiose operating search- servioes can make more 
ratimal decisions about policies and prooedures. , . 

Application of Model 

'Ihe purpose of tJie first application of the ' evaluation mDdel 
was to deterinine to what e-xtent the clieJnt's personal and professional 
background is related to his or her satisfactian with EISO. purpose 
of the second is to dgtemiijie the relationship among the procJedures 
followed ij^^ooessing a search rejuest and the user's gain in kncwled^e 
akd degree of saUsf action. Together^ these assessments should provide 
a good understanding of the factors affectijig user satisfaction witJi the 
service, and thereby suggest irethods of nmintaining and increasing it. 

-nie population for tiiis study is the universe of all 371 searcSies 
nsquested from EISO beto^een May I, 1976 and April 30, 1577. The total 
nuDTber of subjects was 148 (40% of all searches) , but nussing responses 
m soms variables result ir> a sn«li«r nuntoer being ust^ for sane aiicilys««. 

Patii analysis was selected bo analyze ttiu relauunsliips aniong 
input, process, and output variables because it provides a metliod of 
testing the validity' of casual infcrenoos for pairs ^of variables whilu 
oontrolling for die effects of otiier varialjlos. 

Sociological Input Model 

mo are EISO's uisers and hc^ does their identity affect tiioir 
levels of satisfactd,on with tlie sexvico? Ihese ore important questions 
wlilch refloct the succurm of the smrvicc in acdaeving its goals. By 
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iiiplication, if orie^kiiid of client is less satisfied thAn another, 
rfianges in the Wrvice feght ^ ne^ssary in order to raise their^ iGvel 
of satis factiorn^^^""^ 

The cgufis^on as to the users Mdenti ties, is answered here in 
fierins of the too SDciologlcM ^oeptsrrole and status. We \ric^ these 
as dnaracteristics that clienta bring witli than to their enoounter with 
tile sear^di servi(^, and as sudn represent ijiput^ to the systam. SiJ^ce 
status is itself in large pax^t an attribute associat^^d mth a given 
role^ it is difficult to TOasiire these aspects sepaxc^taly. Most of 
tfie variables -we have selcjctecl reflect, to one (degr« another, both 
the role and status of thcj mciividual clie^it. 

Prooess Model 

Kb witii the socio lo<jical input rTo;iel, tiie proosaB irtxlel for 
^expkiining levels of uaer satisfaction represents a suio-systen within 
the larfger evaluation frainework, and involves only a fractuon of tiie 
data i^llected. Key prfoca2ss varialjles are the rethod of contact, the 
system used to searm the data base., the length at tinE retjuireci for ^ 
the search interview md to plan the search stratGcj\/ the Lxjnnect-time, 
the niniber of citations printe<U and price. All of vaiiables 
eXCTrt^^e nr^thod of ODntact relate directly tx^ tiie cxjst uf opexatiny 
the aervicG or tlie prlcxj c±iarged. 

D i scviSiB Lon 

The yrocxm i^xk^i Wari ntoilcratniy MVj^ii^twl ...4, KunUiq Us«r 

(3viTaLi BwitiidfaoL-ian , >uu! s.itiiifacti.ju wUh f^utiwniiai OLjiitontjii t>, ut 
Uiu suLvicei puljIicALy iiwtcrlnla tUid . 11 1 l.iuuh , cxjii vw^iiLaicA, tuid huif 
fuIncBB, and Linx; IxriOHE; . It liui not aituct H.stJ y r u> ;t lun wiUi tho 
tedmology or nvU;r!rialH [ ,u_xliit^-. 1 i-i wilL-t^.tuMiuj this t tiM ent^iul 
offnctof price, it liost- be nuUHi tliat O'V bf all ULio.s rpcxuvcd fi^.. 
soarclios, cind iioat .oUnnrn iMia $30 or iionn It wjuia ai*var, tJion, tliat 
when Lndivtduals are [Xivi^nq for a bibLiograiihtc BCKin-ii, tJiey cxixjc-t niorc 
.in tJic way of scirvicu Ukui would" if Uiey wore- roaiAvimj it for froe. 

Vet, it is ij!i?ortanl: to iioto tiki^ tlicir QKVxictaLions v/L tJi rcgarcl to 
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mrvim do not*-carry Q\Mr to their asSessneJit of the value of the goods, 
v*iiGh they ^parently sEssess in^pendently of anioimt paid. 

'mere is another variable whidi is related to %^ious satis- . 
faction scores v/ith sorm oonsisten^, the stttiDunt leajmed about-, tiie topic 
seardied. This variable is an ou^ut vajriablje in its oth _ri^t, but inter- 
venes between satisfaction and ail prooess variables exoept priae. It is 
positively relatfid to overall satisfaction,^ satisfartion with tijiTeliness 
of service, and nost important, satisf action 'wit^h^e vali^^ of tfie 
bibliogra^y and materiala. Ihls last relationship helps to validate the 
satisfaction itms, Binom one would expect a person who learns more than 
another frm a biJDliograg^y to be more satisfied with At. But more 
inportant, it highU^it^B the idea that the cUent is rrotivated to learn, 
and that if tiiis Learning to^s Twt occur f dissatisfaction will results 

Relationships for the remainder of the prooass rrodel have been 
oonfirrred. PriM is affected by the ninTbar oE citations printed; the 
nuniDer of citations prixited is affected by conoect-=tine but not ixitar- 
view/strategy tiiie; and botli ronnect^tinie and^ interview/strategy tixm mm 
affected by the netliDd of contact.* If tliere' is a suri^rise here, it is 
that vrfiile the personal rontaot is responsible for taking a consider Ale ^ 
armurit of ^^le soardn analyst's ti-iie, Uie prc^uction of ^ongcsr bibliographies 
and hiqlier prices, it SQem to bear no rrelationship to eitlier aniount 
Learned or the lovel of satisfactvion. 

EIJp Today; 'iliu Husult ot teaeaidu Devialai^TTent , 
Dis^^cmi natiuri , cuid Evaluation 

InfonriciUan riystOT for Ontxu lu Lxj(|aii u. U»e e-ar ly yuJOxa » .t Uut. clGCtide 
tho world of online bibLtcxiraphiL; sccaciiing waa in uittincy, Lattie 

docimtanted evidcnuu axjutcd on the ui>tiixal im-thtXla 61 rtuttjjiCj' up a scare)) 
•Mn/ioQ,' ninrtjors of uaurB Uuit. inuihL Ix^ expoctecl tu iu,t' it, or Uic 
inciirrccl in providing i t. 'Llio dioicx; of data bases w^iu Umitod and 
scardunq todiniquos rotatiivuly Biniplc. AtivOToes in tiic fieia havo , 
hoover, token plaoo wi.Ui fiair^anTDn starUxny rapidity nnd theao dianges 
ccniJined with tlw Cindinys of our rcsoarm have affected the develop 
noit of KISO and how it is nm today. The puxpomB of tliis section^ 
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tiierefore, are to present an overview of recent trends and (ievelofmentfi 
in accessing data bases online and to, docaroent the changes that have 
occurred' in the EISO service, 

' Ihese various. changes have, of coiir-ee, profoundly affected the 

type of servicje that EISO is able to offer its user's. For exartpLe, whert 
the service began in Mardi 1975, only one data base (EKCC) was seardned 
and only one system (SDC) used to acoess that file. New several syatans 
including SDC, Lockhee'd, eOTERIS, and Ihe Na^ York Times are used to 
provide access to a variety of data bases iJi education and the closely . 
related social scienoes. 

f The service has expanded its provision of, original docunient-s by 
supplyi-ng users with a choice of the following foMrets: microficdie oopies 
of fiche docLBrents, paper ropies of journal articles , and paper oopies 
of microfiche docunents. The first toro of thetie cations axe supplied 
directly by EISO staff, the last through an arrangenwit witii mcrcMedia, 
a local ooninercial aonpany. 

Pricing policies have been Substantially dianged also. Initially^ 
as a result of data collected' during a "sliort trial i»riod, a flat fee of 
$30 was charged per searcii. Ihen, as it became poasitDle to ct^tain exact 
conputer oosts incurred by eadi searcli^ on tlie printout and as it became 
clear that there was Uttle Unk between' tiJie spent on a seardi by the 
sear* analyst (witiiin the llmit:s set by 'EISO) and the saUsfaction of 
the user, the decision was taken to introduoe a slidtng price structure. 
Now the user, is ciiarged for direct oatputer connect- tijiTe costs, nunter 
of citoUons printed, and a flat rate for the search .analyst's tiJne to tiie 
nearest cjuartiji-hovAi . Thiese oasts asSocidted with acmiiect= tiro and 
citaticjus vary witli the sy stern acxxjaaed exnd dat^ b^ms uaed. Thia i»;w 
pricing structurn has tJiu advantago" of utTtxJsing eOTiaidc diacipliJie on 
the search analyst without reduciny th« guality of Vrm aisardi. 

Publicity efforts have also been scmewhat nvodifiod as a tesult 
of research and pracUcx^. It was found that articb^a and advei tiseineaU, 
in professional jaumals went virtually iintneodcd and did not scivd as 
an effcctivo stunulant for users. Far more ef fectiw were tlie broaiuros 
sent to sd^ool'boardB. Direct mailing to all schools in the province was 
tried but found to be oxt^ssivoly oDstly Cor the nuitter of users generated 
^^^o current ncthods of ^-v'- ' - % , ...u servire oonsit of b^ioe yearly 
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mailings of 12,000 brodiures to sdiool boards, faculties of education, 
professional associations, etc.; f lists distriJDUted at Sumner. and Fall, 
OISE student registrations inclusion of sessions about EISO in graduate 
courses 1010-. Feseardi Ntethods in Educational MndMstration; 1021- ■ 
Retrieval of Knowledge in Educati^on., " and 2050: Disseminatibn and UtiaizaT 
tion of Knowledge in Education. In addition,! hi ^ visibility is .maintined 
by attendanoe at oonferenfs, orientation tours for visiting educators, . 
and the packaging of bibUogxaphies, and original documents in covers with 
the distinctive EI^ logo. 

With tine start of Phase IV of the EISO project in April 19 78, the 
main thrust of the Ministry of Education oontract became the proviBion , • 
of the online bibliograjiiic retrieval service. QDllection of researdn ■ ^ 

data was sharply curtailed mA all data collection instrurmnts were ■ 
revised to reflect the shift in enphasis frtrn researdi project to servioe ' 
ncni boring . Search Regufist Forms, EISO Service Evaluation Data Sheets, 

and EISO User SSvaluation Ojestionnaires are designed to provide infony-, 
tion on who uses tiie servrlce , the purpose for whicii they use it, their 
degree of satisfaction with it, and the osst of provicUng it."" Items 
referring to Other types of infornstaon havB been' eliininated. 

The role of tlie Education Information Consultant or EIC, the 
internEdiary between geographically remote users and the c3ent*-ally located 
InforTOiaon resources, that began in 1975 is continuing tliough in a 
modified formt. Detailed capn studies of the four part-time linkers 
shcjwed that these individuals were .indeed performing a useful function 
OS peroeived by tlieir users, Their greatest contj:ibutj.ons tended to be ^ 
in the early stages of tlie seaxcii process in makirig the potential user 
miare of the servicx; and helping hijn to define and alarify his prciiilem 
or inforTmatian need. The coJcs that dtJVBloped v^-re fiourid tp differ 

significant-ly in tlieir cxjnf u^iratlons with the frmcUons perfut™d, Liirts . ' 

spejit, nunijers of usera varying mcirktjdly from EIC to EIC. One of the 

unexpectod outcxjitwa of Uiu liiilidyt! piograiu waa tiie spriayijiy iii- ut 

voluntiu^ or solf-sclectcd EICS wiio had heard atx^ut tim sarvioe and felt 

tJiat it could be Liseful to tlieir orgarrtzatdon. Hicse volLmteGrs have 

bccx:3mc repeat mers of tlic EISO service and have genernUsd, nimiDrous 

sccu-dies over the past three ytjaxs. . 

The rtjlcs of EISO's staff ntrjibers have also umdergone changes. 
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Ihe jdb of the library assistant v^o • performs the clerical duties of 
the project has expanded with ■ the^troduction of alternative ^\^lication 
fornats, individually- tailoring billing systems, and regular publicly 
mailings. Record keeping, office managenent, and questionnaire roditig ^ 
round out a busy routilne. Hie project rana#r's functions have .so far not 
been as severely curtailed as was antlciE«ted at the begirming of EISO's 
Phase IV. Miile it was thougiit that the reduction of data collectiQn 
and analysis wcwld reduce the tiine needed bo carry out this role, the 
fact that the role had been a shared one" for the first three years of 
the project was lai'gely ovetlooked. It appears that with the respoisi- 
bilities for resear&, project rronitoring, and publicity shifting to 
one individual ; tJie tine^llotaient for that role i^ closer to the 30-40% 
.range than to tiie 10% actuall^ allotted to it. 

Tile greatest diange, however/ has been in fche role of the search 
analyst. Her role ha^ become far more carple^ as a result of the tedi- 
nological t^renda and develoisiBnts described earlier. With more systems 
and.^data bases at her disposal, she njust constaiiUy update her skills 
and the Ust of skills regardecl as necessary, has t«cxane increasingly 
lengthy. The analyst must be kricwledgeable about qLier-y forrnulation and 
result tpinipulation. The fornner includes familiarity witli suffix ratiDval, 
sd'ardi tield contxol, dictLonary access, spelling variations, related 
term capabilil^, word prownlty operators, Boolean operatDrs, r^est 
sets phrase decanposition, seardJi profiles, and sequential searching. 
The latter .includes familiarity with search review, predefined fonnats, 
online format ting, rapid scan, e^janding, sorting, ranking, irdcr-ofiche, 
statlsacal Interface, of flLne .printing, and data acoess protection. 

m&i the EISO project started, whole ficid o£ onlijie biblio- 
graphic retrfcval was relatively new and undsveloped. FW guidelines or 
criteria existed for tlie eat^jbUshnerit and ongouig operaaon of sucii 
servioas, oosts were as yet unciet:erTTiined , and Liser acoeptance was staU 
prdblematic. Within a very short time, tecivio].ogi wii advaiioes made 
possible tlie provision of a wide selection of data bases, costs becaiiii 
iTOre readily determinable, and online access became the accepted way of 
searchuig a, substantial portion of the social science literature, ^ere 
can be little doubt that onlifio services will oontinue to develc^ and ^ 
ejcpand to ireet the inforiration needs of grwing nunters of users in the 
future. 
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